2. Skill: Assess Apprentice Knowledge And Skills

Introduction And Objectives

Evaluating apprentice skills and knowledges is an essen-
tial and inescapable duty of all related subjects instructors.
Unfortunately, few teachers of adults, including many related
studies instructors, have had formal training in tasks associ-
ated with testing. Instead, evaluation skills have been learned
through trial-and-error. As a result, testing too often empha-
sizes less important information or generates information
that may be of little use to you as an instructor.

The purpose of these materials is to ensure that you are
not entrapped by these short-comings. Working through
these materials will sharpen your evaluation skills and
knowledges so that you and the apprentices you train bene-
fit from the time and effort you jointly invest in assessing
learning and performance during related instruction. When
you have completed your work in this unit of materials you
will demonstrate your competence in evaluating trainee
knowledge and skills by being able to:

1.   Distinguish between types of tests useful for assessing
knowledge and skills;

2.   Critique sample test items; and

3.   State the rules for constructing various types of test
items.

Why, What And When To Test

The type of testing with which you must be concerned is
named "Performance Achievement Testing" or "PAT" in
this set of materials. It is well-suited to related subjects
instruction because it is action-oriented and uses observable
behavior to assess learning.

There are three major types of performance achievement
tests, each of which is useful for related instruction evalua-
tion. They differ mainly in the degree they resemble the
work setting. The choice of what type of test to use is yours.
Make your decision based upon the learning outcomes you
desire and the material to be tested. The three types of tests
are: (1) work sample, (2) simulation and (3) knowledge.
In apprenticeship training you must attend to each type of
test. In related studies, your particular concern is with simu-
lation and knowledge type tests; the work sample test
usually is employed in the on-the-job portion of instruction.
Each type of test is discussed on the following several pages,

Work Sample

The work sample test is the type of performance achieve-
ment test with the highest degree of realism. Use it to
measure direct application of knowledge and skills on the
job. Usually a work sample test the sample test requires
apprentices to demonstrate learning outcomes on the job
by evaluating work procedures ancl products on a sample
set of tasks. The sampled tasks must include the most criti-
cal elements of the skills and knowledges that have been
taught. Also they must be representative of the total range
of possible performance outcomes. To insure that you have
selected the most critical learning outcomes to test, usually
you and the journeyman supervisor should analyze the job
and reach consensus about the Importance of required tasks,
skills ancl knowledges. To insure that the apprentice to be
tested understands the expectations of the performance
situation, you should write out the test directions. Include
information about the sequence of work activities and any
test directions such as how to record answers, how scoring
will be accomplished, the value of different answers and
time limits for certain questions and tasks.

Frequently a work sample test will involve several work
stations and many apprentices. In such instances, each
apprentice works alone at a single work station, performing
required tasks while other apprentices work individually at
other work stations. Time limits are placed on activity at
each work station. When time expires, the apprentices move
on to another station, Learning outcomes for each appren-
tice are tested at each work station. The activity at each
work station should be independent of work at any other
work station. Usually, because of the number of apprentices
and work stations, assessment will include use of checklists,
rating scales and written learner answer sheets. A different
test answer sheet is usually necessary for each work station.

Simulation

The simulation type of performance achievement test
has a fairly high degree of realism. It emphasizes the appli-
cation of necessary skills ancl knowledges. Simulation tests
take one of two forms: work-setting and situation. In the
work-setting form of simulation, the apprentice is presented
with a problem like the type he or she will encounter on
the job. Emphasis Is placed on using proper procedures or
on diagnosing or analyzing the problem appropriately, The
idea in designing the test is to replicate some of the critical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